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PROCESSOR WITH CONTINUITY CHECK CACHE 
Field of the Invention 

5 The present invention relates generally to data communication devices and systems, and more 

particularly to network processors or other types of processors utilizable in conjunction with 
processing operations, such as routing or switching, performed on packets or other protocol data 
units (PDUs). 

10 Background of the Invention 

A network processor generally controls the flow of packets between a physical transmission 
medium, such as a physical layer portion of, e.g., an asynchronous transfer mode (ATM) network 
or synchronous optical network (SONET), and a switch fabric in a router or other type of packet 
switch. Such routers and switches generally include multiple network processors, e.g., arranged in 
15 the form of an array of line or port cards with one or more of the processors associated with each of 
the cards. 

Certain network processors may be configured to support the processing of a variety of 
different types of data traffic, such as ATM cells, Internet Protocol (IP) packets, as well as other 
types of packet-based traffic. The ATM traffic is typically in the form of fixed-length 53-byte cells, 
20 each including a 5-byte header and a 48-byte payload, while the IP traffic generally comprises 
variable-length packets. ATM cells and IP packets may be viewed as examples of what are more 
generally referred to herein as PDUs. 

Operation, administration and maintenance (OAM) functions within the network processor 
may be provided in accordance with an established protocol, such as ITU-T Recommendation 1.610, 
25 "B-ISDN Operation and Maintenance Principles and Functions," February 1999, which is 
incorporated by reference herein. 

One type of OAM function relates to continuity checking of network connections. For 
example, the 1.610 Recommendation provides such a continuity check in the ATM context by 
requiring that a given connection be monitored for incoming user cells, and that a timeout be 
30 reported if no cell is received for a period of 3.5 seconds +/- 0.5 seconds. Such a connection is an 
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example of what is more generally referred to herein as a "flow." A number of other OAM 
standards, such as those that are currently evolving for multi-protocol label switching (MPLS), 
provide a similar continuity check mechanism. 

A problem associated with the provision of OAM functionality in a network processor is that 
5 the above-described continuity check is typically implemented in a manner that either consumes an 
excessive amount of on-chip memory, that is, memory internal to the network processor, or requires 
an unduly large number of accesses to a memory external to the network processor. These 
conditions negatively impact the network processor in terms of factors such as size, complexity, 
power consumption and cost, while also limiting processor throughput performance. 
10 Accordingly, a need exists for an improved technique for implementing a continuity check 

in a network processor. 

Summary of the Invention 

The invention provides improved continuity check techniques for processing received cells, 
1 5 packets or other PDUs in a network processor or other type of processor, in a manner that does not 
consume excessive internal memory resources or require an unduly large number of external memory 
accesses. 

In accordance with one aspect of the invention, a network processor or other type of 
processor includes controller circuitry operative to control the performance of a continuity check for 
20 each of a plurality of flows of PDUs received by the processor. The controller circuitry is further 
operative to control access to a set of continuity check counters comprising a counter for each of the 
plurality of flows. 

The processor stores an identifier for each of a subset of the plurality of flows in a continuity 
check cache, and determines if a given flow for which a PDU is received in the processor has a 
25 corresponding entry in the continuity check cache. If the given flow has such an entry, the processor 
prevents a corresponding one of the continuity check counters from being updated, and if the given 
flow does not have such an entry, the processor clears the corresponding one of the continuity check 
counters and stores a flow identifier for the given flow in the continuity check cache. 
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In an illustrative embodiment, each of the flows for which a flow identifier is stored in the 
continuity check cache has had its corresponding continuity check counter cleared upon receipt of 
a first PDU for that flow within a specified time window. As a result, a continuity check performed 
for the given flow requires that the corresponding continuity check counter be reset only once during 
5 a specified time window, even if a plurality of PDUs are received by the processor for the given flow 
within that time window. 

The processor may be configured as a network processor integrated circuit to provide an 
interface between a network and a switch fabric in a router or switch. 

Advantageously, the techniques of the invention in the illustrative embodiment process 
10 received PDUs in a manner that substantially reduces the number of external memory accesses 
required in conjunction with the performance of continuity checks, while also limiting the amount 
of on-chip memory resources that are consumed. The illustrative embodiment provides an efficient 
mechanism for allowing a large number of continuity check counters in external memory to be reset 
without unnecessarily wasting memory bandwidth or sacrificing on-chip area. As a result, processor 
15 throughput performance is considerably improved, without significantly increasing the size, 
complexity, power consumption or cost of the processor. 

Brief Description of the Drawings 

FIG. 1 is a simplified block diagram of an information processing system in which the 
20 present invention is implemented. 

FIG. 2 shows an exemplary configuration of a continuity check cache in an internal memory 
of a network processor in the illustrative embodiment of the invention. 

FIG. 3 is a flow diagram of continuity check operations implemented in the FIG. 1 system 
in accordance with the techniques of the invention. 
25 FIG. 4 illustrates one possible implementation of a network processor of the FIG. 1 system 

as an integrated circuit installed on a line card of a router or switch. 
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Detailed Description of the Invention 

The invention will be illustrated herein in conjunction with an exemplary information 
processing system which includes a network processor configured in a particular manner. It should 
be understood, however, that the invention is more generally applicable to any processor in which 
5 it is desirable to provide more efficient continuity checking than is possible using the conventional 
techniques described above. 

A "processor" as the term is used herein may be implemented, by way of example and 
without limitation, utilizing a microprocessor, central processing unit (CPU), digital signal processor 
(DSP), application-specific integrated circuit (ASIC), or other type of data processing device, as well 
10 as portions or combinations of these and other devices. 

The term "controller circuitry" as used herein is intended to include any portion of a 
processor or other type of logic or processing circuitry which is capable of performing or otherwise 
controlling at least a portion of an operation associated with a continuity check. 

The term "memory circuitry" as used herein is intended to include a separate memory as well 
15 as a particular portion of a larger memory, and may refer to internal memory, external memory or 
combinations thereof. 

The terms "protocol data unit" and "PDU" as used herein are intended to include a cell, a 
packet, or other identifiable grouping of information. 

The present invention in an illustrative embodiment is configured such that a network 
20 processor includes controller circuitry configurable to control processing operations associated with 
performance of continuity checks for multiple flows received by the network processor. 

FIG. 1 shows an information processing system 100 in which the invention is implemented. 
The system 100 includes a network processor 102 having an internal memory 104. The network 
processor 102 is coupled to an external memory 106 as shown, and is configured to provide an 
25 interface between a network 108 from which PDUs are received and a switch fabric 110 which 
controls switching of PDU data. The processor 102 and its associated external memory 106 may be 
implemented, e.g., as one or more integrated circuits installed on a line card or port card of a router 
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or switch. In such a configuration, the switch fabric 1 10 is generally considered to be a part of the 
router or switch. 

One or both of the internal and external memories 104, 106 may be utilized to implement 
otherwise conventional network processor memory elements such as PDU buffer memory, queuing 
5 and dispatch buffer memory, etc. 

In accordance with an aspect of the invention, the network processor 102 includes controller 
circuitry comprising a controller 120. In addition, the internal memory 104 includes a continuity 
check cache 122, and the external memory 106 includes a set 124 of continuity check counters 
comprising individual counters 124 0 , 124 l5 . . . 124 N , also denoted Counter 0, Counter 1 , . . . Counter 

10 N, respectively. Each of the counters corresponds generally to a particular identifiable network 
connection or other type of flow for which PDUs may be received and processed by the network 
processor. The value of N is purely arbitrary, and may take on any value that is implementable in 
a given processor. An exemplary value of N in a typical network processor may be on the order of 
256K, or 262,144, although other values can of course be used. 

15 Generally, the continuity check cache 122 includes substantially less than N entries, with 

each of the entries at any given point in time corresponding generally to a particular one of the N 
counters of the continuity check counters 124, as will be further described in conjunction with FIG. 
2 below. 

By way of example, the continuity check cache 122 in the illustrative embodiment in which 
20 N = 256K may include only eight entries. Other larger or smaller numbers of entries may also be 
used, such as 16, 32, etc. The invention does not require any particular relationship between the 
number of cache entries and the number N of continuity check counters, and the relationship can be 
determined in a straightforward manner for a particular implementation based on design goals and 
other implementation-specific factors. 
25 Although in FIG. 1 the continuity check cache 1 20 is shown as being part of internal memory 

1 04 and the set of continuity check counters 1 24 is shown as being part of external memory 1 06, this 
is by way of example only. Other types and arrangements of memory circuitry may be used in 
implementing the continuity check cache and continuity check counters, and the invention is not 
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limited in this regard. It should be noted, however, that for large values of N, such as values on the 
order of 256K, it is generally preferable to store the counters in external memory, in order to 
conserve the on-chip memory resources of the processor. 

The controller 120 is configurable for use in performing continuity checks for multiple flows 
5 received by the network processor 102, utilizing the continuity check cache 122 and the continuity 
check counters 124. The controller 120 may be viewed as an illustrative example of network 
processor controller circuitry operative to control the performance of a continuity check for each of 
a plurality of flows of PDUs received by the processor. The continuity check cache 122 stores an 
identifier for each of a subset of the plurality of flows, and the controller 120 controls access to the 

10 set 124 of continuity check counters, which as indicated previously comprise a counter for each of 
the plurality of flows. The controller 120 is operative to determine if a given flow for which a 
protocol data unit is received in the processor has a corresponding entry in the continuity check 
cache. If the given flow has such an entry, a corresponding one of the continuity check counters is 
prevented from being updated, and if the given flow does not have such an entry, the corresponding 

15 one of the continuity check counters is cleared and a flow identifier is stored for the given flow in 
the continuity check cache. 

The terms "clear" and "reset" as used herein in the context of a counter are used 
interchangeably and are intended to include, by way of example and without limitation, setting the 
counter from a current value back to a zero count value, or setting the counter from a current value 

20 to some other non-zero value. 

It will be assumed without limitation that, in the illustrative embodiment, the continuity 
check functionality of the network processor 102 may be provided in a manner that conforms to an 
established protocol, such as the above-noted ITU-T Recommendation 1.610 for OAM functions. 
However, the invention does not require the use of this particular protocol, or any other standard 

25 protocol, and can be configured using non-standard OAM techniques as well as combinations of 
standard and non-standard OAM techniques. 

The particular arrangement of system elements shown in FIG. 1 is by way of illustrative 
example only. More particularly, as previously noted, the invention can be implemented in any type 
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of processor, and is not limited to any particular PDU processing application. Also, the system 100 
and network processor 1 02 may include other elements in addition to or in place of those specifically 
shown, including one or more elements of a type commonly found in a conventional implementation 
of such a system and network processor. For example, the network processor may include at least 
5 one of a classifier, a scheduler, queuing and dispatch logic, and other conventional elements not 
explicitly shown in the figure. These and other conventional elements, being well-understood by 
those skilled in the art, are not described in detail herein. 

It is also to be appreciated that the network processor 102 as shown in FIG. 1 is considerably 
simplified for purposes of illustration, and in a given embodiment may include additional circuitry, 

10 such as one or more memory controllers, as well as appropriate interface circuitry for interfacing 
with the network 108, the switch fabric 1 10, and other external devices, such as an associated host 
processor or other device which communicates with the network processor 102 over a standard bus 
architecture, e.g., a peripheral component interconnect (PCI) bus. 

The continuity check functionality of the network processor 1 02 as described herein may be 

1 5 implemented at least in part in the form of software program code. For example, the controller 1 20 
may be implemented at least in part utilizing elements that are programmable via instructions or 
other software that may be supplied to the network processor 1 02 using conventional arrangements, 
such as the above-noted host processor. 

FIG. 2 illustrates one possible implementation of the continuity check cache 122 within the 

20 internal memory 1 04 of the network processor 102. In this example, the continuity check cache 122 
includes a plurality of entries 200, with each of the entries storing a particular flow identifier. There 
are a total of M entries in the continuity check cache, and the entries correspond to particular ones 
of the counters in the set of continuity check counters 124 in external memory 106. As indicated 
previously, the number M of entries in the continuity check cache is generally substantially less than 

25 the number N of continuity check counters in external memory. 

The flow identifiers stored in the continuity check cache comprise information identifying 
particular flows of PDUs that are received and processed by the network processor. These flow 
identifiers are illustratively shown in FIG. 2 as comprising flow identifiers Flow 1 , Flow 2, . . . Flow 
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M. Such identifiers can be formatted using any of a number of conventional techniques, as will be 
appreciated by those skilled in the art. 

As mentioned previously, performance of a continuity check in accordance with ITU-T 
Recommendation 1.610 in the ATM context requires that a flow be monitored for incoming user 
5 cells, and that a timeout be reported if no cell is received for a period of 3.5 seconds +/- 0.5 seconds. 
The present invention in the illustrative embodiment utilizes a three-bit counter for each of the 
continuity check counters 124 in order to implement this type of continuity check. Of course, the 
particular counter arrangement of the illustrative embodiment is not a requirement of the invention, 
and numerous alternative arrangements can be used, with other types of multi-bit counters. 

10 Each increment of the count of a given one of the continuity check counters generally 

represents a specified time window within a designated period of time for which the continuity check 
is performed. In the case of the above-described 1.610 continuity check, the time windows each have 
a duration of approximately 0.5 seconds, and there are seven such windows within the 3.5 second 
period of time for which the 1.610 continuity check is performed. A three-bit counter is therefore 

15 used in the illustrative embodiment in order to allow counting of the seven intervals, with each 
increment of the count corresponding to a time window having a duration of approximately 0.5 
seconds. The counter is incremented for each of the 0.5 second time windows for which a user cell 
is not received on the corresponding flow. If a user cell is received on the corresponding flow, the 
counter is reset to zero. If the counter reaches seven, this indicates that no cell has been received on 

20 the corresponding flow in 3.5 seconds, such that the continuity check fails and a suitable timeout 
indication is then generated in a conventional manner. 

During normal operation, a given active flow may receive millions of user cells during the 
0.5 second time window. This can be problematic in that each of the cells received on the given flow 
during the 0.5 second time window will cause the three-bit counter to be reset to zero. Thus, if 100 

25 cells are received during the 0.5 second window, a processor that does not include a continuity check 
cache would require 100 accesses to external memory, with only the first one being useful. Since 
the increment for each counter in the present example only occurs once every 0.5 seconds, all of the 
user cells after the first one will redundantly reset the counter over and over again, which clearly 
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wastes memory bandwidth. A possible alternative approach is to set one bit for each active flow to 
indicate if the counter for that flow has already been cleared during the timeout window. This 
prevents multiple accesses to memory for the same flow, but requires that a bit be stored in internal 
memory for every possible flow. In the illustrative embodiment in which N = 256K, this would 
5 require 256K bits of on-chip storage, which would generally be viewed as an excessive consumption 
of on-chip memory resources. 

The present invention advantageously addresses the above-described issues in a manner that 
substantially reduces the required number of external memory accesses while also limiting the 
amount of on-chip memory resources that are consumed. The invention in the illustrative 
10 embodiment provides an efficient mechanism for allowing a large number of continuity check 
counters in external memory to be reset without unnecessarily wasting memory bandwidth or 
sacrificing on-chip area. 

FIG. 3 is a flow diagram 300 which illustrates the manner in which continuity checking is 
performed in the network processor 102 in accordance with the invention. In this example, the 
1 5 received PDUs are assumed to correspond to ATM cells, and the continuity check is again assumed 
to be performed in accordance with the 1.610 protocol. 

In step 302, a user cell is received for a given flow. 

In step 304, a determination is made as to whether given flow matches an entry in the 

continuity check cache 122. That is, an identifier of the given flow is compared to the cache entries, 
20 and a determination is made as to whether or not a match exists between the identifier of the given 

flow and any particular cache entry. Such a match is also referred to as a cache "hit." 

If there is not a hit for the given flow in the cache, this indicates that the corresponding 

continuity check counter in external memory has not yet been reset in the current time window. 

Therefore, in step 306 the corresponding continuity check counter 124 in external memory is cleared, 
25 that is, reset to zero, and an identifier of the given flow is stored in the continuity check cache. The 

process then returns to step 302 to process the next user cell received on the given flow or any other 

flow. 
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If there is a hit for the given flow in the cache, this indicates that the corresponding continuity 
check counter in external memory was already reset once in the current time window. Therefore, 
in step 308 the corresponding continuity check counter is not accessed or otherwise updated based 
on the user cell received in step 302. The process then returns to step 302 to process the next user 
5 cell received on the given flow or any other flow. 

The use of the continuity check cache 122 in the manner illustrated in the FIG. 3 example 
prevents multiple user cells on the same continuity check flow from clearing the same counter in 
external memory within the 0.5 second time window. 

In the illustrative embodiment, each of the flows for which a flow identifier is stored in the 
1 0 continuity check cache has had its corresponding continuity check counter cleared upon receipt of 
a first cell or other first PDU for that flow within a specified time window. Therefore, in conjunction 
with a continuity check performed for a given flow a corresponding one of the continuity check 
counters is reset only a single time for a plurality of PDUs received by the processor for the given 
flow within a specified time window. 
1 5 Preferably, the entries of the continuity check cache 1 22 are cleared after expiration of each 

of the plurality of time windows for which the continuity check counters can be incremented. For 
example, in the 1.610 protocol context, the continuity check cache entries are cleared after each of 
the 0.5 second time windows. The cache will thereby maintain a list of the particular flows for 
which at least one cell or other PDU has been received within the current time window of the 
20 continuity check. 

The particular steps shown in FIG. 3 should be considered as examples of PDU processing 
operations in accordance with the illustrative embodiment of FIGS. 1 and 2, rather than as limiting 
the scope of the invention in any way. 

A more specific example of a set of processing operations carried out in accordance with the 
25 FIG. 3 process is as follows. 

1. At time = 0, Counter 1 is 0. 

2. At time = 0.5 seconds, all counters 124 are incremented and the continuity check cache 
is cleared. Counter 1 is now 1 . 
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3. At time = 0.55 seconds, a new cell is received on Flow 1, which is associated with 
Counter 1 . There is no entry in the cache for Flow 1 , so Counter 1 is cleared in external memory to 
0. A new entry in the cache is allocated with an identifier of Flow 1 . 

4. At time = 0.56 seconds, another cell is received on Flow 1 . Since the cache has an entry 
5 for this flow, Counter 1 is hot accessed or otherwise updated in external memory. Counter 1 is still 

0. 

5. At time = 0.57-0.99 seconds, 10 other cells are received for Flow 1 but these do not result 
in an access or update to Counter 1 in external memory since there is an entry in the cache for this 
flow. Counter 1 is still 0. 

10 6. At time =■ 1.0 seconds, all counters are incremented and the cache is again cleared. 

Counter 1 is now 1 in external memory. 

7. At time =1.1 seconds, a new cell is received on Flow 1. There is no entry in the cache 
for Flow 1, so Counter 1 is cleared in external memory to 0. A new entry in the cache is allocated 
with an identifier of Flow 1, and the process repeats. 

15 In the above example, Counter 1 reflects the correct state of 0 for a given time window in 

which a cell has been received, without having to access external memory for all user cells after the 
first one in each time window. Otherwise, there would have been 10 unnecessary memory accesses 
in step five to clear a counter that was already 0. 

Again, this particular example is for illustrative purposes only, and should not be viewed as 

20 restricting the scope of the invention in any way. 

A situation may arise in which the continuity check cache 122 is already full when a new 
flow arrives at the processor. In this case, a particular flow identifier may be removed from the 
cache to make room for storage of a flow identifier for the new flow. If an additional cell or other 
PDU is received for the removed flow during the current time window, this will result in an access 

25 to the corresponding counter in external memory, and an attempt to add an identifier for that flow 
back into the cache. The actual hit rate of the cache will generally depend on factors such as traffic 
burstiness and the size of the cache. For example, bursty traffic would tend have more user cells on 
a given flow, so the cache hit rate would tend to be higher and therefore would reduce the number 
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of external memory accesses. The cache size can be selected in a straightforward manner to handle 
the expected number of outstanding flows and traffic burstiness in order to maintain a desired hit 
rate in the cache. 

FIG. 4 illustrates an example router or switch line card embodiment of a portion of the 
system 100 of FIG. 1 . In this embodiment, the processing system comprises a line card 400 having 
at least one integrated circuit 402 installed thereon. The integrated circuit 402 comprises network 
processor 102 which has internal memory 104. The network processor 102 interacts with external 
memory 1 06 on the line card 400. The external memory 1 06 includes the above-described continuity 
check counters 124, and may also be used to support other functions, for example, it may serve as 
an external tree memory for the network processor integrated circuit. The above-noted host 
processor may also be installed on the line card 400. The portion of the processing system as shown 
in FIG. 4 is considerably simplified for clarity of illustration. It is to be appreciated, however, that 
the processing system may comprise a router or switch which includes multiple such line cards, and 
that each of the line cards may include multiple integrated circuits. A similar embodiment may be 
implemented in the form of a port card in a router or switch. 

The above-described embodiments of the invention are intended to be illustrative only. For 
example, although the illustrative embodiment of FIG. 1 utilizes controller 120 in implementing 
processing operations associated with continuity checks for multiple flows, other embodiments may 
utilize different types of controller circuitry for implementing such operations. In addition, other 
embodiments can use different continuity check cache and continuity check counter configurations 
for implementing the described functionality. Also, the invention does not require the use of any 
particular flow identifier format, and such identifiers can be configured as any type of information 
capable of indicating at least one characteristic of a given flow. These and numerous other 
alternative embodiments within the scope of the following claims will be readily apparent to those 
skilled in the art. 
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